Systems and methods for providing a global virtual network (gvn)

ABSTRACT

Systems and methods for managing a global virtual network connection between an endpoint device and an access point server are disclosed. In one embodiment the network system may include an endpoint device, an access point server, and a control server. The endpoint device and the access point server may be connected with a first tunnel. The access point server and the control server may be connected with a second tunnel.

RELATED APPLICATION

This application is a continuation of Ser. No. 15/563,253, filed Sep.29, 2017, which is a U.S. National Stage application under 35 U.S.C. §371 of International Patent Application No. PCT/US2016/026489, filedApr. 7, 2016, which claims the benefit of and priority to U.S.Provisional Application No. 62/144,293, filed on Apr. 7, 2015, and U.S.Provisional Application No. 62/151,174, filed on Apr. 22, 2015, each ofwhich is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION Technical Field

The present disclosure relates generally to networks, and moreparticularly, a global virtual network and various associated ancillarymodules.

Description of the Related Art

Human beings are able to perceive delays of 200 ms or more as this istypically the average human reaction time to an event. If latency is toohigh, online systems such as thin-clients to cloud-based servers,customer relationship management (CRM), enterprise resource planning(ERP) and other systems will perform poorly and may even ceasefunctioning due to timeouts. High latency combined with high packet losscan make a connection unusable. Even if data gets through, at a certainpoint too much slowness results in a poor user experience (UX) and inthose instances the result can be refusal by users to accept thoseconditions in effect rendering poorly delivered services as useless.

To address some of these issues, various technologies have beendeveloped. One such technology is WAN optimization, typically involvinga hardware (HW) device at the edge of a local area network (LAN) whichbuilds a tunnel to another WAN optimization HW device at the edge ofanother LAN, forming a wide area network (WAN) between them. Thistechnology assumes a stable connection through which the two devicesconnect to each other. A WAN optimizer strives to compress and securethe data flow often resulting in a speed gain. The commercial driver forthe adoption of WAN optimization is to save on the volume of data sentin an effort to reduce the cost of data transmission. Disadvantages ofthis are that it is often point-to-point and can struggle when theconnection between the two devices is not good as there is little to nocontrol over the path of the flow of traffic through the Internetbetween them. To address this, users of WAN optimizers often opt to runtheir WAN over an Multiprotocol Label Switching (MPLS) or DDN line orother dedicated circuit resulting in an added expense and again usuallyentailing a rigid, fixed point-to-point connection.

Direct links such as MPLS, DDN, Dedicated Circuits or other types offixed point-to-point connection offer quality of connection and Qualityof Service (QoS) guarantees. They are expensive and often take asignificantly long time to install due to the need to physically drawlines from a POP at each side of the connection. The point-to-pointtopology works well when connecting from within one LAN to the resourcesof another LAN via this directly connected WAN. However, when thegateway (GW) to the general Internet is located at the LAN of one end,say at the corporate headquarters, then traffic from the remote LAN of asubsidiary country may be routed to the Internet through the GW. Aslowdown occurs as traffic flows through the internet back to servers inthe same country as the subsidiary. Traffic must then go from the LANthrough the WAN to the LAN where the GW is located and then through theInternet back to a server in the origin country, then back through theinternet to the GW, and then back down the dedicated line to the clientdevice within the LAN. In essence doubling or tripling (or worse) theglobal transit time of what should take a small fraction of globallatency to access this nearby site. To overcome this, alternativeconnectivity of another internet line with appropriate configurationchanges and added devices can offer local traffic to the internet, ateach end of such a system.

Another option for creating WAN links from one LAN to another LANinvolve the building of tunnels such as IPSec or other protocol tunnelsbetween two routers, firewalls, or equivalent edge devices. These areusually encrypted and can offer compression and other logic to try toimprove connectivity. There is little to no control over the routesbetween the two points as they rely on the policy of various middleplayers on the internet who carry their traffic over their network(s)and peer to other carriers and or network operators. Firewalls androuters, switches and other devices from a number of equipment vendorsusually have tunneling options built into their firmware.

While last mile connectivity has vastly improved in recent years therestill exist problems with long distance connectivity and throughput dueto issues related to distance, protocol limitations, peering,interference, and other problems and threats. As such, there exists aneed for secure network optimization services running over the top ofstandard internet connections.

SUMMARY OF THE DISCLOSURE

A global virtual network (GVN) is a type of network which offers networkoptimization over the top (OTT) of the internet. It is a disruptivetechnology which provides a low cost alternative to costly MPLS ordedicated lines. Having a secure tunnel between an end point device(EPD) and an access point server (SRV_AP) linked to the broader GVNglobal network offers many advantages. The core technologies of the GVNwere created to fill gaps where solutions were required but for whichtechnology did not exist.

In addition to the broader theme of addressing quality of service (QoS)issues related to the network connectivity which improve generalperformance and enhance user experience, two other main features arethat this topology allows for the extension of a network edge into thecloud. Additionally, the EPD acts as a bridge between the broadernetwork and a local area network (LAN) bringing elements of the cloud asa local node extension into the edge of the LAN.

The disclosed subject matter describes various ancillary modules of theglobal virtual network which are either facilitated by a GVN or whichassist it in its operations. The geographic destination claims have todo specifically with how the CDA and the CPA work, as well as theirinteractions and coordinated efforts. The geocasting element describeshow the GeoD mechanism can offer a reverse-CDN geocasting operationutilizing the topology of the GVN. The tunnels describe what can be donewith the plumbing from a higher level. Architecture and algorithm/logicinventions describe component parts. Graphic user interface and relatedHW and SW frameworks are also outlined as is file transferring.

Systems and methods for managing a virtual global network connectionbetween an endpoint device and an access point server are disclosed. Inone embodiment the network system may include an endpoint device, anaccess point server, and a control server. The endpoint device and theaccess point server may be connected with a first tunnel. The accesspoint server and the control server may be connected with a secondtunnel.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to facilitate a fuller understanding of the present disclosure,reference is now made to the accompanying drawings, in which likeelements are referenced with like numerals or references. These drawingsshould not be construed as limiting the present disclosure, but areintended to be illustrative only.

FIG. 1 illustrates the packet bloat for IP transport packets whenheaders are added to the data at various layers.

FIG. 2 illustrates the packet bloat of data and headers at each of theseven layers of the OSI model.

FIG. 3 shows a block diagram depicting resolution of universal resourcelocator (URL) via lookup through internet domain name system (DNS) forrouting from Host (client) to the numeric IP address of the Host(server).

FIG. 4 illustrates, in accordance with certain embodiments of thedisclosed subject matter, an equation to calculate bandwidth delayproduct (BDP) for a connection segment or path taking into accountvarious connectivity attributes.

FIG. 5 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the traffic flow path within an end pointdevice (EPD).

FIG. 6 illustrates, in accordance with certain embodiments of thedisclosed subject matter, an over the top (OTT) tunnel created on top ofa regular internet connection.

FIG. 7 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a virtual interface for over the top (OTT)tunnels created on top of a regular internet connection.

FIG. 8 illustrates a conventional embodiment of flow of the Internettraffic.

FIG. 9 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a tunnel (TUN) built between two gatewaydevices (GWD).

FIG. 10 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the communications between EPD 100, SRV_CNTRL200, and SRV_AP 300 via the neutral API mechanism (NAPIM) of the GVN viapaths API-10A1-10A2, API-10A3-10A2, and API-10A1-10A3.

FIG. 11 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the flow of information required by two peersin a peer pair.

FIG. 12 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a process of building a tunnel.

FIG. 13 is a flowchart illustrating the logical used to assign a port toan IP address used to build a tunnel in accordance with certainembodiments of the disclosed subject matter.

FIG. 14 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the importance of a server availability listand how IP addresses and ranges are assigned for various devices.

FIG. 15 illustrates, in accordance with certain embodiments of thedisclosed subject matter, elements of a GVN Tunnel from LAN to EPD toSRV_AP to SRV_AP to EPD to LAN, including peering points peering pointsbetween ISPs and network edges.

FIG. 16 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a multi-perimeter firewall (MPFW) in the cloudsupporting a personal end point device.

FIG. 17 illustrates, in accordance with certain embodiments of thedisclosed subject matter, how tables on the databases of various GVNdevices are related to each other and in which way they interact.

FIG. 18 shows, in accordance with certain embodiments of the disclosedsubject matter, a block diagram of technology used by and enabled by aglobal virtual network (“GVN”).

FIG. 19 illustrates, in accordance with certain embodiments of thedisclosed subject matter, three devices that work together to providegeographic destination services to a client to optimize the retrieval,transfer, and serving of content from servers located in a remotelocation.

FIG. 20 further illustrates the operation of the three devices describedin FIG. 19 in accordance with certain embodiments of the disclosedsubject matter.

FIG. 21 is an exemplary embodiment which continues to describe theoperation of a geographic destination mechanism further explaining theretrieval of a series of files from various types of servers, theclumping together of the retrieved files and the subsequent transmissionfrom the access point server (SRV_AP) to the end point device (EPD).

FIG. 22 illustrates the prior art of how geocasting works within acontent delivery network (CDN).

FIG. 23 illustrates the analysis and interpretation of periods of tickcycles.

FIG. 24 describes how a description of two different sets of data canprovide information when comparing various dissimilar data sets inaccordance with certain embodiments of the disclosed subject matter.

FIG. 25 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the integration of a multi-perimiter firewallwith other systems in a GVN.

FIG. 26 illustrates, in accordance with certain embodiments of thedisclosed subject matter, both paths through the open Internet as wellas paths which are a combination of network optimized traffic with ablend of global virtual network (GVN) segments over the top (OTT) of thebase Internet and open Internet segments.

FIG. 27 illustrates a GVN using hub and spoke topology with a backboneand octagon routing in accordance with certain embodiments of thedisclosed subject matter.

FIG. 28 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a distributed end point administrative cluster(DEPAC) which can be virtually constructed within a global virtualnetwork (GVN) or other similar topology.

FIG. 29 illustrates the logical construction of a series of tests to berun on the Internet testing various ports and IP addresses in accordancewith certain embodiments of the disclosed subject matter.

FIG. 30 illustrates a mechanism for logging of connectivity trafficactivity between various devices operating in a global virtual network(GVN) or other similar topologies in accordance with certain embodimentsof the disclosed subject matter.

FIG. 31 illustrates the traditional thick stack 31-20 layered accessbetween the application layer 31-800 and a network interface card (NIC)31-000 as compared to a thin stack approach 31-10 which directlyaccesses the NIC 31-000 in accordance with certain embodiments of thedisclosed subject matter.

FIG. 32 illustrates a simple example databases schema for relating andstoring connectivity information from both tests and productionenvironment usage.

FIG. 33 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the usage of custom commands that act as adefensive cushion between a trigger on an application layer such as abutton clicked on a graphic user interface and the deep logic andcommands to be run as a result of the trigger.

FIG. 34 is a simplified description of the modules on related devices ina geographic destination mechanism within a global virtual network (GVN)in accordance with certain embodiments of the disclosed subject matter.

FIG. 35 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a few ways how a portable end point device(PEPD) might connect to a global virtual network (GVN) or similartopology.

FIG. 36 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationship between a portable end pointdevice (PEPD) and an access point server (SRV_AP) 36-300.

FIG. 37 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some of the different types of extensiblesoftware that may be run on a portable end point device (PEPD) where thesoftware is stored on a remote device such as an access point server(SRV_AP) to be sent from the SRV_AP to the PEPD.

FIG. 38 illustrates, in accordance with certain embodiments of thedisclosed subject matter, multiple tunnels between devices within aglobal virtual network (GVN) across multiple regions.

FIG. 39 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the framework for a common code base to beutilized by various types of devices, with each having their ownattributes/type and identity.

FIG. 40 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationships, interaction, and relevanceof data to various devices within a global virtual network (GVN).

FIG. 41 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the topology of a global virtual network (GVN)over the top (OTT) of the Internet and various devices operating withinit.

FIG. 42 illustrates, in accordance with certain embodiments of thedisclosed subject matter, code both above the web root and below the webroot.

FIG. 43 illustrates, in accordance with certain embodiments of thedisclosed subject matter, algorithms incorporating information fromexternal sources with AI knowledge learned internally.

FIG. 44 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a simplified representation of an approach todesigning a smarter algorithm by taking into account factors that onehas and balancing against one's personal needs.

FIG. 45 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device (EPD), central control server (SRV_CNTRL), and an accesspoint server (SRV_AP).

FIG. 46 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device (EPD), central control server (SRV_CNTRL), and an accesspoint server (SRV_AP).

FIG. 47 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device(EPD), central control server (SRV_CNTRL), and an accesspoint server.

FIG. 48 illustrates a block diagram of an exemplary computing deviceaccording to certain embodiments of the disclosed subject matter.

FIG. 49 illustrates a process of the downloading of a file in a LAN aswell as the downloading a file from the Internet in accordance withcertain embodiments of the disclosed subject matter.

FIG. 50 illustrates the operation of a file transfer manager (FTM) on anend point device (EPD) and of an FTM on an access point server (SRV_AP)in accordance with certain embodiments of the disclosed subject matter.

FIG. 51 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationship between the physical storageof a file on a secure file storage volume, the saving of informationabout the file into a relational database (DB), and data relationshipsbetween files, file information, and steps in a file transfer process.

DETAILED DESCRIPTION

In the following description, numerous specific details are set forthregarding the systems, methods and media of the disclosed subject matterand the environment in which such systems, methods and media mayoperate, etc., in order to provide a thorough understanding of thedisclosed subject matter. It will be apparent to one skilled in the art,however, that the disclosed subject matter may be practiced without suchspecific details, and that certain features, which are well known in theart, are not described in detail in order to avoid complication of thedisclosed subject matter. In addition, it will be understood that theexamples provided below are exemplary, and that it is contemplated thatthere are other systems, methods, and media that are within the scope ofthe disclosed subject matter.

A global virtual network (GVN) offers secure network optimizationservices to clients over the top (OTT) of their standard internetconnection. This is an overview of the constituent parts of a GVN aswell as a description of related technologies which can serve as GVNelements. GVN elements may operate independently or within the ecosystemof a GVN such as utilizing the GVN framework for their own purposes, orcan be deployed to enhance the performance and efficiency of a GVN. Thisoverview also describes how other technologies can benefit from a GVNeither as a stand-alone deployment using some or all components of aGVN, or which could be rapidly deployed as an independent mechanism ontop of an existing GVN, utilizing its benefits.

A software (SW) based virtual private network (VPN) offers privacy via atunnel between a client device and a VPN server. These have an advantageof encryption and in some cases also compression. But here again thereis little to no control over how traffic flows between VPN client andVPN server as well as between the VPN server and host server, hostclient or other devices at destination. These are often point-to-pointconnections that require client software to be installed per deviceusing the VPN and some technical proficiency to maintain the connectionfor each device. If a VPN server egress point is in close proximity viaquality communication path to destination host server or host clientthen performance will be good. If not, then there will be noticeabledrags on performance and dissatisfaction from a usability perspective.It is often a requirement for a VPN user to have to disconnect from oneVPN server and reconnect to another VPN server to have quality or localaccess to content from one region versus the content from anotherregion.

A Global Virtual Network (GVN) is a type of computer network on top ofthe internet providing global secure network optimization servicesutilizing a mesh of devices distributed around the world securely linkedto each other by advanced tunnels, collaborating and communicating viaApplication Program Interface (API), Database (DB) replication, andother methods. Traffic routing in the GVN is always via bestcommunication path governed by Advanced Smart Routing (ASR) powered byautomated systems which combine builders, managers, testers, algorithmicanalysis and other methodologies to adapt to changing conditions andlearning over time to configure and reconfigure the system.

The GVN offers a service to provide secure, reliable, fast, stable,precise and focused concurrent connectivity over the top of one or moreregular Internet connections. These benefits are achieved throughcompression of data flow transiting multiple connections of wrapped,disguised and encrypted tunnels between the EPD and access point servers(SRV_AP) in close proximity to the EPD. The quality of connectionbetween EPD and SRV_AP's is constantly being monitored.

A GVN is a combination of a hardware (HW) End Point Device (EPD) withinstalled software (SW), databases (DB) and other automated modules ofthe GVN system such as Neutral Application Programming InterfaceMechanism (NAPIM), back channel manager, tunnel manager, and morefeatures which connect the EPD to distributed infrastructure devicessuch as access point server (SRV_AP) and central server (SRV_CNTRL)within the GVN.

Algorithms continually analyze current network state while taking intoaccount trailing trends plus long term historical performance todetermine best route for traffic to take and which is the best SRV_AP orseries of SRV_AP servers to push traffic through. Configuration,communication path and other changes are made automatically and on thefly with minimal or no user interaction or intervention required.

Advanced Smart Routing in an EPD and in an SRV_AP ensure that trafficflows via the most ideal path from origin to destination through an assimple as possible “Third Layer” of the GVN. This third layer is seen byclient devices connected to the GVN as a normal internet path but with alower number of hops, better security and in most cases lower latencythan traffic flowing through the regular internet to the samedestination. Logic and automation operate at the “second layer” of theGVN where the software of the GVN automatically monitors and controlsthe underlying routing and construct of virtual interfaces (VIF),multiple tunnels and binding of communication paths. The third andsecond layers of the GVN exist on top of the operational “first layer”of the GVN which interacts with the devices of the underlying Internetnetwork.

The cloud from a technical and networking perspective refers to devicesor groups or arrays or clusters of devices which are connected and areavailable to other devices through the open internet. The physicallocation of these devices is not of significant importance as they oftenhave their data replicated across multiple locations with deliveryto/from closest server to/from requesting client utilizing contentdelivery network (CDN) or other such technology to speed connectivitywhich enhances user experience (UX).

In some embodiments, the disclosed subject matter is related toincreasing utility value of firewalls (FW) by extending perimeters intothe cloud. A firewall is a device primarily designed to protect aninternal network against the external threats from an outside network,as well as protecting the leakage of information data from the internalnetwork. A firewall has traditionally been placed at the edge betweenone network such as a local area network (LAN) and another network suchas its uplink to a broader network. Network administrators havesensitivities about the placement and trustworthiness of a FW because oftheir reliance on it to secure their networks.

FIG. 1 illustrates the packet bloat for IP transport packets whenheaders are added to the data at various layers. At the ApplicationLayer 1-L04, the data payload has an initial size as indicated by Data1-D4. The size of the packet is indicated by Packet Size 1-PBytes. Atthe next layer, Transport Layer 1-L03, the Packet Size 1-PBytes has theoriginal size of the data 1-D4 which is equal to Data UDP 1-D3. Itfurther includes bloat of Header UDP 1-H3. At the next layer, InternetLayer 1-L02 the body payload Data IP 1-D2 is a combination of 1-D3 and1-H3. It increases 1-PBytes by Header IP 1-H2. At the Link Layer 1-L01,Frame Data 1-D1 is a combination of 1-H2 and 1-D2. It further increases1-PBytes by Header Frame 1-H1 and Footer Frame 1-F1.

FIG. 2 illustrates the packet bloat of data and headers at each of theseven layers of the OSI model. The original data 2-D0 grows at eachlevel Application OSI Layer 7 2-L7 with the addition of headers such asHeader 2-H7. At each subsequent layer down from layer 7 to layer 1, thedata layer is a combination of the previous upper level's layer of Dataand Header combined. The total packet bloat in an OSI model at thePhysical OSI Layer 2-L1 is denoted by Packet Size 2-PBytes.

FIG. 3 shows a block diagram depicting resolution of universal resourcelocator (URL) via lookup through internet domain name system (DNS) forrouting from Host (client) to the numeric IP address of the Host(server). A content request or push from host (client) source 101 tohost (server) target 301 as files or streams or blocks of data flows inthe direction of 001. The response 002 of content delivery from host(server) target 301 to host (client) source 101 as files or streams orblocks of data. The host (client) source 101 in Client-Server (C-S)relationship that makes request to access content from a remote host(server) or sends data to remote host (server) via a universal resourcelocator (URL) or other network reachable address.

The connection from the host client to the internet is marked asP01—connection from client 101 to POP 102 directly facing or can belocated in a local area network (LAN) which then connects to theinternet via a point of presence (POP) can be referred to as the lastmile connection. The point of presence (POP) 102 which representsconnection provided from an end point by an internet service provider(ISP) to the internet via their network and its interconnects. If theURL is a domain name rather than a numeric address, then this URL issent to domain name system (DNS) server 103 where the domain name istranslated to an IPv4 or IPv6 or other address for routing purposes.

Traffic from client 101 to server 301 is routed through the Internet 120representing transit between POPs (102 and 302) including peering,backhaul, or other transit of network boundaries.

The connection P02 from POP 102 to DNS 103 to look up a number addressfrom a universal resource locator (URL) to get the IPv4 address or othernumeric address of target server can be directly accessed from the POP102, or via the Internet 120. The connection P03 from POP 102 of an ISPto the Internet 120 can be single-honed or multi-honed. There is aconnection P04 from the Internet 120 to the ISP's or internet datacenter's (IDC) internet-facing POP 302. The connection P05 from the POP302 of the server to the host 301 can be direct or via multiple hops.

The lookups from name to numeric address via domain name systems is astandard on the Internet today and assumes that the DNS server isintegral and that its results are current and can be trusted.

FIG. 4 illustrates, in accordance with certain embodiments of thedisclosed subject matter, an equation to calculate bandwidth delayproduct (BDP) 4-080 for a connection segment or path taking into accountvarious connectivity attributes. The further the distance between thetwo points and/or other factors which increase latency impact the amountof data that the line can blindly absorb before the sending device knowsreceives back a message from the recipient device about whether or notthey were able to accept the volume of data.

In short, the BDP 4-080 calculation can represent a measure of how muchdata can fill a pipe before the server knows it is sending too much attoo fast a rate.

The Bandwidth 4-000 can be measured in megabits per second (Mbps) andGranularity 4-002 can be unit of time relative to one second. Toaccurately reflect BDP 4-080, the Bytes 4-020 are divided by the numberof Bits 4-022 of a system. Latency 4-050 is a measurement of round triptime (RTT) in milliseconds (ms) between the two points.

So for example, BDP 4-080 of the following network path with theseattributes—Bandwidth 4-000 of 10 GigE using Granularity 4-022 of onesecond, on an eight bit system over a path with Latency 4-050 of 220ms—can be calculated as follows:

${\frac{10,000,000,000}{1}*\frac{1}{8}*{0.2}20} = {275,000,000\mspace{14mu} {bits}\mspace{14mu} {OR}\mspace{14mu} 33,569.3\mspace{14mu} {MB}}$

Therefore on a 10 GigE line, the sending device could theoretically send33,569.3 megabytes of information (MB) in the 220 ms before a messagecan be received back from the recipient client device.

This calculation can also be the basis of other algorithms such as oneto govern the size of a RAM buffer, or one to govern the time and amountof data that is buffered before there is a realization of a problem suchas an attack vector. The throttling down by host server could lead tounderutilized pipes but the accepting too much data can also lead toother issues. The calculation of BDP 4-080 and proactive managementapproach to issues leads to efficient utilization of hardware andnetwork resources.

FIG. 5 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the traffic flow path within an end pointdevice (EPD). The traffic flows between the LAN 5-000 and the end pointdevice (EPD) 5-100 over connection 5-CP00. End point device (EPD) 5-100flows to the point of presence (POP) 5-010 over connection 5-CP06. Thepoint of presence (POP) 5-010 is connected to the Internet 5-020 viaconnection 5-CP08.

FIG. 6 illustrates, in accordance with certain embodiments of thedisclosed subject matter, an over the top (OTT) tunnel created on top ofa regular internet connection. FIG. 6 is similar to FIG. 5 andadditionally shows an access point server (SRV_AP) 6-300. The accesspoint server (SRV_AP) 6-300 includes a tunnel listener TNL0 6-380. Theend point device (EPD) 5-100 includes a tunnel manager TMN0 6-180. Atunnel TUN0 6-CP80 is constructed that connects the tunnel manager TMN06-180 and the tunnel listener TNL0 6-380. The tunnel is constructedover-the-top (OTT) of the regular internet connection 6-CP06 and 6-CP08.

FIG. 7 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a virtual interface for over the top (OTT)tunnels created on top of a regular internet connection. FIG. 7 issimilar to FIG. 6 and additionally includes a virtual interface (VIF) asa hook point on each device EPD 7-100 and SRV_AP 7-300 for multipletunnels to be built between two. This figure also shows multiple tunnels7-CP80, 7-CP82, and 7-CP84 between EPD 7-100 and SRV_AP 7-300. A mainadvantage of the virtual interface VIF0 7-170 and VIF0 7-370 on eachdevice respectively is that this approach enables clean structuralattributes and a logical pathway for more complex constructs of tunnelsand subsequent routing complexity.

Certain other advantages with regards to timing and flow control will bedescribed in subsequent figures below.

FIG. 8 illustrates a conventional embodiment of flow of the Internettraffic. In FIG. 8, the traffic through the Internet is from a Host(client) Origin 8-101 connected to a local area network (LAN) 8-102 to apoint of presence (POP) 8-103 of an Internet service provider (ISP) tothe Internet 8-301 to a POP 8-204 of an Internet data center (IDC) 8-203to a load balancer 8-202 routing traffic to a Host (server) Target8-201.

The client and the server both have little to no control over the routesthat their traffic takes through the Internet and other networks betweenthem.

FIG. 9 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a tunnel (TUN) built between two gatewaydevices (GWD). In FIG. 9, GWD A1 and GWD B1 are each located between theedges EDGE-1 and EDGE-2 of their internal networks and the openInternet. The TUN connects the two local area networks (LAN) into abroader wide area network (WAN). The GWD A1 receives its connectivityfrom an Internet service provider ISP-1 and GWD B1 from ISP-3. A keypoint is that while the TUN offers security and other benefits, thereare potential negative issues because traffic from ISP-1 destined forISP-3 must transit through the network of ISP-2.

Congestion due to saturation, packet loss, or other issues can occur atpeering points PP-01 and/or at PP-02 or within the network of ISP-2.Because neither GWD A1 nor GWD B1 is a client of ISP-2, they have toreach ISP-2 via complaining to their respective ISP of ISP-1 or ISP-3.

Another thing to note is that while the Internet path may consist ofmany hops such as, for example, external hop (EH) EH1 through EH17,within the TUN there will be only one hop at each of the end points ofthe tunnel. The tunnel is an encrypted path over the top (OTT) of theopen Internet.

FIG. 10 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the communications between EPD 10-100,SRV_CNTRL 10-200, and SRV_AP 10-300 via the neutral API mechanism(NAPIM) of the GVN via paths API-10A1-10A2, API-10A3-10A2, andAPI-10A1-10A3.

For tunnels TUN10-1, TUN10-2, and TUN10-3 to be built between EPD 10-100and SRV_AP 10-300 as well as for tunnels from EPD 10-100 to other SRV_APservers such as TUN10-4 and from other EPDs to SRV_AP 10-300 viaTUN10-5, each device in the peer pair requires certain information pertunnel.

The NAPIM mechanism stores relevant credentials, coordinates and otherinformation for each side of a peer pair to utilize when building newtunnels via the Tunnel Managers 2110 and 2310. The server availabilitymechanism 2222 on the SRV_CNTRL 10-300 evaluates the performance ofvarious tunnels tested on the EPD side via Tunnel Tester 2112 and theSRV_AP side by Tunnel Tester 2312. The information from the tests isrelayed to the Connectivity Analyzer 2288 on the SRV_CNTRL 10-200. Testresults include assigned IP address and port combinations, ports used,results from historical combinations use, results from port spectrumtests, and other related information.

Server availability lists present the EPD 10-100 with a list of IPaddresses and ports which could be utilized by the Tunnel Manager tobuild new tunnels. The SRV_AP 10-300 and other SRV_AP servers noted onthe list will be notified listen for connection attempts to be made byEPD 10-100.

Server availability prioritizes the list of SRV_AP IP address and portcombinations based on expected best performance of the tunnels to bebuilt while also looking at current load of available SRV_AP servers,balancing assigned lists given to other EPDs as well as other availableinformation.

FIG. 11 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the flow of information required by two peersin a peer pair. The peers can either be a Client (C) and a Server (S),or a Peer to another Peer in a P-2-P topology. For simplicity oflabeling and descriptions within this example embodiment, the C to S andP-2-P represent the same type of two peer relationship, with C to Sdescribed herein. The GVN mainly uses C to S relationships betweendevices but its methods and technology can also be applied to P-2-P peerpairs for tunnel building.

An encrypted tunnel by its nature is a secure communication path throughwhich data can flow. When the Client and the Server are separated bydistance and the connection between them is over the open, unencryptedInternet, an encrypted tunnel is an ideal channel through which tosafely exchange data. If there is a human network administrator ateither end, they can program devices. But there exists a challenge onhow to relay security information like pass phrases, keys and otherinformation. Some may use a voice phone call to coordination, others aseries of postings through secure web sites to share information orother methods. Manually setting up a single tunnel can be a task.Administering multiple tunnels can become onerous.

To automatically build a series of encrypted tunnels between two devicesin a peer pair there exists a need to securely share information. Thetunnel information also needs to be current and securely stored on adevice. Furthermore, during the establishment process, there existthreats which must be addressed. While a tunnel is up, other threatsexist which need to be addressed.

SRV_CNTRL 11D00 is a central server which contains Repository managinginformation in Database tables, files stored in a Secure File Storagesystem, lists in memory and other related information. The SRV_CNTRLalso has algorithms and mechanisms to evaluate certain data to generateinformation reports.

Client Device 11D01 represents a device which will initiate the buildingof a tunnel by “dialing” the connection to the Server device via aspecific IP Address and Port. There can be many Client devices 11D01concurrently connected to the GVN with similar software andconfiguration with a differentiating factor between Clients of uniquedevice Identity, UUID's, and also unique information per tunnel perClient.

Server Device 11D02 represents a device which will be listening forclient connection attempts on specific IP Addresses and Ports. If theClient follows correct protocol and establishment sequence, and presentscorrect credentials and other security information, the Server willallow the Client to build a tunnel to it. There can be many Serverdevices 11D02 concurrently connected to the GVN with similar softwareand configuration with a differentiating factor of unique deviceIdentity, UUID's, and other unique information.

Tunnel Info 11S2 shows the information stored on a Client Device 11D01and a Server Device 11D02. Each device can establish multiple tunnelsand each tunnel will have its own set of Tunnel Information and SecurityInformation. Some tunnel information sets may be used for building ofcurrent active tunnels and other tunnel info sets may be held in reservefor future tunnels.

Certain information between the C and S is equivalent such as apass-phrase which one will present to the other, and other informationwill be different depending on applicability. Information requirementsfor building of a tunnel between two points can include: client/servertopology and settings; IP and port of each end point to be used by thetunnel; tunnel metrics including MTU size, protocol, and otherinformation used for its operations; keys, pass phrases and otherinformation about security protections used for the tunnel; SSLcertificates and other information for protecting the informationexchange pre-tunnel UP; and other information. The information is sharedbetween devices using specific API Action calls of the Neutral API ofthe GVN.

Before Tunnel 11S0 describes the process of receiving and sharinginformation between devices 11D01 and 11D02 and the repository 11D00 onSRV_CNTRL and back to devices 11D01 and 11D02. API Communication PathsAPI-CP0, API-CP2, API-CP4, and API-CP6 represent Request-Responseinformation exchange with the arrows representing the direction of theflow of information from one device to another device.

Server 11D02 reports information to Receive Info C-0 module of theSRV_CNTRL 11D00 device via path API-CP0. SRV_CNTRL 11D00 receivesinformation from servers and stores relevant Identity, Tunnel, CurrentLoad and other information in its repository. For example, algorithmsand AI logic on SRV_CNTRL 11D00 analyze server load and based on currentand anticipated demand from Client 11D01 devices, Server AvailabilityC-1 matrix is updated. The Server Availability C-1 information may beconveyed by database replication through the API of the GVN to Clients11D01 via Share Info C-6 module via API call path API-CP6, by directfile sharing via GVN, or other method.

Client 11D01 reports information to Receive Info C-0 module of theSRV_CNTRL 11D00 device via path API-CP2. This information will be storedin the repository of SRV_CNTRL 11D00. Specific tunnel information from aClient 11D01 can be shared with Server 11D02 by Share Info C-6 modulevia path API-CP4.

SRV_CNTRL 11D00 compiles a current List of Clients 11C-4 per serverwhich it publishes to Server 11D02 via Share Info C-6 via path API-CP4.

If either Client 11D01 or Server 11D02 detects problems in establishmentof tunnel utilizing current tunnel information, one or the other devicecan request a new set of tunnel information to be generated by SRV_CNTRLvia API-CP2 or API-CPO respectively. New tunnel info sets can be sharedvia Share Info C-6 with both peers in a peer pairing with Client 11D01info sent via API-CP4 and Server D02 info sent via API-CP6.

The List of Clients C-4 and the current state of a Server 11D02 willhave a direct impact on the Server Availability C-2.

Each Server 11D02 needs to organize, secure and coordinate its List ofClients C-4 which will attempt to build new tunnels to shared resourcesof Server 11D02. This information will be fluid and need to be updatedregularly via secure API calls to SRV_CNTRL 11D00.

The need to securely harmonize info between devices is essential toprotect the integrity of tunnels between them.

Tunnel Build S4 phase describes the process of tunnel establishment viaShare Info C-6. Refer to FIG. 11 for the steps taken between Client andServer to build the tunnel. The path TP0 represents path between Client11D01 and Info Exchange C-10 and from Info Exchange C-10 to Server 11D02via path 11TP2.

Establishment Threats C-8 refers to threats to Info Exchange C-10 duringtunnel establishment. If the signature of the tunnel type is visible,then there may be threats during the tunnel establishment C-8 such asfake Transport Layer Security (TLS) handshakes from illegitimate actorsin the middle, TLS errors on handshake, Port and IP identificationresulting in blocking or obstructing, time outs due to filteringdevices, reset packets sent by ISP or firewall or device in the middle,or other threats.

If the Info Exchange C-10 is successful, the Build Tunnel C-12 step willbe taken with routes applied and other related actions to enable thetunnel TUN to be securely built between Client 11D01 and Server 11D02.

Tunnel UP S6 describes the period during normal flow of traffic througha tunnel. It is essential to convey information between devices andthere exists a need on SRV_CNTRL 11D00 to manage unique info for variousClient 11D01 and Server 11D02 devices, as well as for multiple tunnelsto be built between them.

The exchange of information between devices has to be a regularoccurrence as there exists a recurring need to make fresh, new dynamictunnels. Some ports on an IP address may be blocked or become blockedand simply changing the port for that IP address will allow the tunnelto be built and for data to flow. Furthermore, each tunnel needs one ormore unique ports per IP Address to avoid collisions between tunnels.When a Client 11D01 device requests new tunnel information to becreated, a random port number is generated and the port availability forthat specific IP address on the target Server 11D02 is checked againsttwo or more factors including; if that port is already in use by anexisting tunnel (either an operational one or one on standby which couldbe made operational), and if that port has been used by that specificClient 11D01/Server 11D02 peer pair in the past and if it has beenblocked. In both cases, a new random number will be generated. There are65,536 ports available per IP address with a certain number reserved forspecific services. A floor for example of 5,500 would leave available60,036 ports which could be used by the random number generator with amin of 5001 and max of 65536. When a tunnel is dismantled and the portis marked as blocked for a peer pair, it is made available to other peerpairs to utilize. This freeing up of ports is necessary to avoidexhaustion of ports. Therefore the tracking IP and Port combinations bySRV_CNTRL 11D00 is essential.

A tunnel can help with its own establishment through steps but it alsohas limitations. While secure, most tunnels are visible duringestablishment. The handshake and signature of what kind of tunnel it ismay be visible during operation. Manually set keys are cumbersome andnot often changed and if used for too long, the risk that they can bebroken increases; therefore keys should be re-keyed with new ones on afrequent basis.

Automated systems need to ensure that information such as new keys,ports to IP Addresses and other info can be created and that thisinformation is available to both sides of the peer pair so that tunnelscan be built and rebuilt. Both sides have to be configured & ready to beable to build tunnels. Therefore, the exchange of info between peerpairs needs to be secure or integrity of the security of the tunnelitself is compromised.

While tunnel is up and pushing traffic, operational threats C-14 exist.The tunnel signature may be visible (e.g. if the tunnel is sniff-ableand not obfuscated). The structure of the tunnel may be known if type oftunnel is able to be discovered. This risks the stream of packets beinggrabbed and brute force key breaking being used to decrypt the contentsof the tunnel. Or a reset signal can break tunnel if the reset code orother tunnel control codes are known. Therefore to maintain tunnelsecurity and integrity between Client 11D01 and Server 11D02 devices ina peer pair, the updating and sharing of information needs to beautomated and secure.

The GVN structure allows devices to be enabled for automated securetunnel establishment between peer pairs based on most currentinformation. A combination of security features and methodologies offerself-reinforcing protections.

FIG. 12 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a process of building a tunnel. The exampleshown in FIG. 12 demonstrates managers, modules, processes, databases(Db), storage devices (HFS), paths and other features for thecommunication between three pertinent players in the tunnel building andmanaging process.

In this example, a single tunnel TUN0 12-CP80 is built between an endpoint device (EPD) 12-100 and an access point server (SRV_AP) 12-300.The tunnel is initiated by the Tunnel Manager (Builder) 12-D110 on theEPD 12-100. It “dials” a specific point on an IP address which is beinglistened to by the Tunnel Manager (Listener) 12-D310 on the SRV_AP12-300.

The three main steps between the builder and the listener are thehandshake (12-S1), the information exchange (12-S2) and the tunnel buildprocess (12-S3).

There are also other communications paths described such as path 12-CP02which could be a direct SSH or equivalent type of directdevice-to-device communication.

An API path 12-PA1 between EPD 12-100 and a central control server(SRV_CNTRL) 12-200 and another API path 12-PA2 between SRV_AP 12-300 andSRV_CNTRL 12-300 can be utilized to securely share information about thetunnel, about the peers EPD 12-100 and SRV_AP 300, or other relatedinformation via SRV_CNTRL 12-300.

Within each device, the Tunnel Managers collaborate with other modulesand managers such as Device Manager 12-D120 and 12-D320, as well asothers.

Paths 12-TP01 to 12-TP02 between EPD 12-100 and SRV_AP 300 can representanother dedicated tunnel for information exchange in addition to thetunnel for data traffic TUN0 12-CP80.

FIG. 13 is a flowchart illustrating the logical used to assign a port toan IP address used to build a tunnel in accordance with certainembodiments of the disclosed subject matter. The flow takes into accountvarious factors when selecting the port and IP address to use.

The first step is to gather parameters 13-010 for the port to IP addressassignment by checking to see if desired port and IP_Addrress have beenspecified to be used by a specific device by its Device_ID, and otherfactors. The parameters also delineate a floor value and a roof valuefor port number, and more governing settings.

The “logic gate IP+Port specified? 13-020” step checks to see if thereis a request for a specific port attached to a specific IP address for aserver device by Device_IP.

If the port and IP address have been specified, then the availabilityfor their use is accepted and logic follows path Yes 13-P022. If apreferential port and IP are not specified then logic follows path No13-P030 to random number generator for a random port to be generatedwithin range 13-030.

A lookup is done at step 13-050 to check against current and historicaluse (via path 13-B102 to Db Registry 13-B100) for that port to IPaddress mapping to see if the port is free or if it is currently in use.A secondary check is done by looking at historical use to see if itindicates if that port and IP combination has been used in the past bythis device or other devices, and if so, if that use proved to berelatively problematic. Some unstable or unreliable ports due tofiltering or congestion through devices or other reasons can be markedas being problematic. If there is also a trend for blocking ofproblematic ports for other devices, then the port to IP addresscombination can be marked as unavailable.

If the port is not available at step 13-060, the process of generating aport to IP address mapping is restarted via junction point 13-012.

If the port is available, then the port to IP address will be assignedfor use at step 13-100. This assignment will be saved in the Db registry13-B100 via path 13-B112. Next, the Port to IP Address assignment ispublished via an API call 13-120 so that relevant devices know about theavailability status of the port. The last step is to log the assignment13-130 of port to IP address including the logic used and other factorswhich could assist in improving the efficiency of future portassignments.

FIG. 14 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the importance of a server availability listand how IP addresses and ranges are assigned for various devices.Although IPv6 offers a huge range of possible IP addresses, the IPv4standard has a finite amount of both public and private IP addresses.This has an influence on which EPDs can connect which SRV_APs.

In this figure, EPD 14-100 builds tunnels with SRV_APs 14-300, 14-302and 14-306. EPD 14-102 builds tunnels with SRV_APs 14-300, 14-304, and14-308.

This example demonstrates how the internal IP range 10.10.191.0 through10.10.191.255 can be used on two SRV_APs 14-302 and 14-304, and IP range10.10.192.0 through 10.10.192.255 can be used on both SRV_AP 14-306 and14-308.

Therefore for example, 10.10.191.18 can but used by EPD 14-100 to builda tunnel to SVR_AP 14-302 and at the same time 10.10.191.18 can also beused by EPD 14-102 to connect with SRV_AP 14-304.

EPD 14-100 and EPD 14-102 do not have to directly interact with eachother to avoid conflicts because the server availability list publishedfor each EPD in coordination with the TUN manager will assign IP address(internal and external) combinations for EPDs to connect with SRV_APswithout any conflicts.

FIG. 15 illustrates, in accordance with certain embodiments of thedisclosed subject matter, elements of a GVN Tunnel from LAN to EPD toSRV_AP to SRV_AP to EPD to LAN, including peering points peering pointsbetween ISPs and network edges,. This illustrates an end-to-end GVNtunnel(s) between edges of two LANs via two SRV_APs and it also furtherillustrates more information about different Internet Service Providers(ISP) carrying traffic over certain portions of the Internet betweenEH-3 and EH-15.

EDGE-1 is the demarcation point for network access connection betweenthe devices of LAN-1 and the POP of ISP-1. PP-01 is the point wherepeering occurs between the ISP-1 and ISP-2 networks. PP-02 is the pointwhere peering occurs between the networks of ISP-2 and ISP-3. EDGE-2 isthe demarcation point for network access connection between devices ofLAN-2 and the POP of ISP-3.

Some advantages can be realized by placing SRV_AP-1 at PP-1 so that thisSRV_AP directly can peer with both ISP-1 and ISP-2. More advantages canbe realized by placing SRV_AP-2 at PP-2 so that this SRV_AP can directlypeer with both ISP-2 and ISP-3. If the network of ISP-2 is not ideal, itis possible for traffic to be alternatively routed around ISP-2 by theGVN through another route or line or ISP or carrier.

The hop count through the neutral Third Layer of the GVN is eight. Thedistance between ISPs is not to scale. Furthermore, it is likely thatthere could be more hops within the network of an ISP but for simplicitysake, the quantity illustrated has been limited.

FIG. 16 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a multi-perimeter firewall (MPFW) in the cloudsupporting a personal end point device. This figure shows portabledevices which would hook into the GVN from a mobile location and where16-M1 boundary is the edge between a personal area network (PAN) 16-010and the GVN.

This figure shows the topology of a personal end point device (PEPD)16-130 with some of its connectivity and other functionality distributedin the cloud. This figure further describes firewall operationsdistributed into the cloud along with those other operations performedin the cloud on behalf of a local device such as a personal end pointdevice (PEPD) 16-130. Where a PEDP 16-130 is a less powerful and moreportable device than an end point device (EPD), it can still takeadvantage of the personal area network connectivity afforded by a GVN,including features such as advanced smart routing (ASR), multi-perimeterfirewalls, and more.

The key point illustrated is that the personal device spreads its needfor processing power into the cloud. The modules residing on the PEPDinclude hardware components for processor CPU 106, memory RAM 108, andnetwork interface NIC 102. The operating system is a minimal O/S 110 toprovide a platform for system software System SW 112 and a Connectivity172 module. This basic configuration is enough to allow the PEPD 16-130to build a tunnel 16-TUN2 between itself and an access point serverSRV_AP 16-300.

The component parts at the SRV_AP 16-300 hardware components forprocessor CPU 306, memory RAM 308, and network interface NIC 302. Theoperating system O/S 310 is a more extensive install than O/S 110. O/S310 provides a platform for system software System SW 312 and aConnectivity 372 module for the SRV_AP 16-300. Advanced smart routing(ASR) 350 module and other modules 370 offer functionality both to theSRV_AP 16-300 and to the connected PEPD-16-130.

The PEPD 16-130 may be dependent on the tunnel 16-TUN2 to be up and ableto carry traffic to realize cloud based ASR, FW and other operationalfunctionality.

FIG. 17 illustrates, in accordance with certain embodiments of thedisclosed subject matter, how tables on the databases of various GVNdevices are related to each other and in which way they interact. Forexample, the repository database DB_2300 on the SRV_CNTRL has varioustables on it related to devices and the interaction between devices viathe neutral API mechanism (NAPIM) of the GVN. Tables such as DeviceRegistry DBT_2310 in database DB_2300 is designated as REPO_ACTIVE whichmeans that it receives information from many sources, is read/write andis able to be queried as the source of information for selective or fullreplication to tables such as Device Identity DBT_2102 as a part of thedatabase EPD Local Db DB_2100. This table DBT_2101 has the designationSEL_REP+W which allows for selective replication from DBT_2310 as wellas for it to report relevant identity back to the device registry.

The control and release of information is governed by data managers.Database table type designators include REGULAR for normal, read/writetables, as REP_INFO for read only, replicated tables, as SEL_REP readonly, partially replicated tables with only related rows, asREPOS_ACTIVE a table combined from all sources on repository for deviceregistry DBT_2310 such as identities. Other possibilities includeLOGGING from source tables to be combined on the database DB2800 onSRV_LOGS. These designations for tables are for example only and may bedifferent in real world use and there are many more tables and othertypes based on use.

FIG. 18 shows, in accordance with certain embodiments of the disclosedsubject matter, a block diagram of technology used by and enabled by aglobal virtual network (“GVN”) including the GVN core elements G0, GVNmodules G100, and technology enabled G200 by the global virtual networkGVN. The GVN core includes an overview of the mechanism G1 and itsconstituent component parts of Topology G2, Construct G3, Logic G4, andControl G5 layers. The GVN core G0 also incorporates the relations toand with GVN Elements G6.

The GVN can include plug-in and/or stand-alone GVN modules G100including but not limited to: Neutral API Mechanism (“NAPIM”) G102,described in PCT International Application No. PCT/US16/12178, which isincorporated herein by reference in its entirety; Geodestination(“Geo-D”) G104, described in PCT International Application No.PCT/US15/64242, which is incorporated herein by reference in itsentirety; Advanced Smart Routing (“ASR”) G106, Connect G108, and othermodules G110 described in U.S. Provisional Application US62/151,174,which is incorporated herein by reference in its entirety.

The GVN also provides a platform which can enable other technologiesincluding but not limited to: Network Tapestry G202; MPFWM G204; NetworkSlingshot G206; Network Beacon G208, Granularity of a tick G210, andother technologies G212. These are described in in U.S. ProvisionalApplication 62/174,394 and U.S. Provisional Application 62/266,060,which are incorporated herein by reference in their entireties.

GVN Modules (G100) and Technology (G200) enabled by GVN can operate ontop of an existing GVN, as a component part of a GVN, or can beindependent and utilize all or some isolated parts of a GVN to supporttheir own stand-alone operations.

FIG. 19 illustrates, in accordance with certain embodiments of thedisclosed subject matter, three devices that work together to providegeographic destination services to a client to optimize the retrieval,transfer, and serving of content from servers located in a remotelocation.

The devices are an end point device (EPD) 19-100, an access point server(SRV_AP) 19-300, and in a supporting capacity, a central control server(SRV_CNTRL) 19-300.

A content delivery agent (CDA) 19-D120 operates on the EPD 19-100, and acontent pulling agent operates on the SRGV_AP 19-300.

The CDA 19-D120 coordinates with the advanced smart routing (ASR)19-D102 module on the EPD 19-100 as well as with the cache manager19-D130.

CPA 19-D320 communicates with the URL lookup and DNS cache manager19-D310 and it directly provides instructions and receives informationfrom the Remote Fetcher BOT (RFBOT) 19-D328, as well as coordinating itsactions with the cache manager 19-D330 on the SRV_AP 19-300.

The CPA 19-D320 receives instructions from the CDA 19-D120 to contact acontent server to retrieve content from a target server.

FIG. 20 further illustrates the operation of the three devices describedin FIG. 19 in accordance with certain embodiments of the disclosedsubject matter. The three devices, which constitute a geographicdestination mechanism, include an end point device (EPD) 20-100, anaccess point server (SRV_AP) 20-300, and a central control server(SRV_CNTRL) 20-200.

The content pulling agent (CPA) 20-D320 receives instructions from thecontent delivery agent (CDA) 20-D120 that the Client 20-800 connected tothe EPD 20-100 has requested geographic destination fetching andretrieval of content from a content server 20-600 that is located in theregion where the SRV_AP 20-300 resides.

The CPA 20-D320 receives the instructions from the CDA 20-D120 to fetchcontent from a URL. The CPA 20-D320 passes this information to theremote fetcher BOT (RFBOT) 20-D328 to do a lookup of the URL to see ifits DNS information is locally cached at 20-D310. If it is cached andthe information is not stale, then the cached information is used. Ifthe information is not in the cache, or if it is stale, a fresh lookupwill be made to DNS server 20-604. The results will be returned andstored in 20-D310. The RFBOT 20-D328 notifies the CPA 20-D320 that ithas successfully obtained DNS information. The CPA 20-D320 instructs theRFBOT 20-D328 to contact the content server 20-600 and it fetches thecontent file(s) from that server. The RFBOT 20-D328 passes the contentto the CPA 20-D320 for parsing to seek for more content links which areembedded in the fetched content. The CPA 20-D320 then collaborates withthe URL Lookup and DNS cache manger 20-D310 and as well as with theRFBOT 20-D328 to fetch information about the network coordinates of theserver(s) where the other content resides. For examples, an assetsserver 20-602 may host images, CSS, JavaScript, and other related assetsfiles. Streaming files may be served from streaming specific servers20-606, files may be served from file servers 20-610, and includedcontent from third parties will be available from their servers 20-608.

FIG. 21 is an exemplary embodiment which continues to describe theoperation of a geographic destination mechanism further explaining theretrieval of a series of files from various types of servers, theclumping together of the retrieved files and the subsequent transmissionfrom the access point server (SRV_AP) 21-200 to the end point device(EPD) 21-100.

After the content files are successfully retrieved by the RFBOT 21-D328,they are passed to the Cache Manager 21-D330. The information about eachfile as well as the manifest of all of the files retrieved is analyzedby the content pulling agent (CPA) 21-D320. This information is conveyedto the cache manager 21-D330 as well as to the cache manager 21_D130 onthe EPD 21-100.

The manifest of content file information is further shared with thecontent delivery agent (CDA) 21-120 on the EPD 21-100. The CDA 21-120communicates with the cache manager 21-130 to expect and receive theclump of files from 21700 to be de-clumped and individually served froma local host on the 21-100 to serve clients connected and in closeproximity to the EPD 21-100.

In many respects, this operates like a reverse of content deliverynetwork.

FIG. 22 illustrates the prior art of how geocasting works within acontent delivery network (CDN) where a server in one region S 22-00 hascontent like streaming video that clients located in another region suchas C 22-20, C 22-22, and/or C 22-24 desire to retrieve said content.There are bandwidth and latency issues that impede the transporting ofthe information over a long distance from S 22-00 located in one regionto the clients in another region.

To mitigate the negative effects, the owner of S 22-00 may set up ageocasting server (GS) such as GS 22-10 to buffer content from S 22-00or act as a streaming reflector for live streams from S 22-00 to beefficiently served by GS 22-10 to the clients C 22-20, C 22-22, and/or C22-24.

FIG. 23 illustrates the analysis and interpretation of periods of tickcycles. Artificial intelligence can assist in future calculations toestimate how long the processing and post processing times of a tickwill take based on quantities of items to process taking into accountsystem resources and other factors.

Per period calculated metrics with data from current period, short termand long term historical data can be plotted on a standard deviationcurve based on the various cyclical trends. Notation of lows, highs,averages and other analysis can indicate whether current performance isin line with expectations or is better, worse, or otherwise differentthan previous experience.

This data gathering and contextual analysis assists artificialintelligence (AI) algorithms in decision making.

Current period 13-T08 can be compared with short term 13-T18 and longterm 13-T28 performance data.

FIG. 24 describes how a description of two different sets of data canprovide information when comparing various dissimilar data sets inaccordance with certain embodiments of the disclosed subject matter.

A key point is that while Group 1 has A, B, C, D, and F sets of data,Group 2 contains data sets A, C, D, and E. Information from the directcomparison where there is an overlap for sets A, C, and D can provide acontrast or corroboration of characteristics of the sets being compared.

And a comparison of the results of B set against E set may also provideinsight into differences and alternatives which could be considered.

An intelligent algorithm which will be presented with different sets ofdata at different times needs to be able to compare sets which overlapbetween groups as well as being able to take into account how to analyzesets which are in one group and not in the other group, and to weightthis into the results.

FIG. 25 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the integration of a multi-perimeter firewallwith other systems in a GVN. Acts of information warfare are alwaysoccurring. Whether they are by nation state, by corporate players,hackers, or other actors, these attacks are relentless and according totrends, the threats are increasing. Utilizing the topology describedherein, there exists the possibility to integrate information about liveattacks which is detected by passive firewalls or other such monitoringmiddle devices on the internet aggregated and reported by securityprovider companies or organizations. Whether the nature of the attack isan intrusion, phishing attack, attempt to steal intellectual property,DDoS attack, or other threat known or unknown, the key point is toprotect one's network.

FIG. 25 shows request/response (REQ/RESP) API loops between variousdevices. These information loops can share information that a cloudfirewall such as CFW-DPI 25-142LB or CFW-SPI 25-144LB learns abouttraffic flowing through it which is reported to SRV_CNTRL 25-200. Theinformation loops can share information about attacks in otherlocalities by passing information from SRV_CNTRL 25-200 to the cloudfirewall such as CFW-DPI 25-142LB or CFW-SPI 25-144LB. Furthermore theinformation stored in the database Db 25-B200 on SRV_CNTRL 25-200 canalso contain heuristic patterns, signatures of known threats, as well asinformation from global internet monitoring feeds to be shared.Visibility for a human administrator can also be made available from ahosted instance on EPD 25-100 via a graphic user interface (GUI) on theClient 25-018 via path 25-GUI-AJAX.

The flexibility of this information exchange topology also allows forperformance monitoring, billing module for cloud-based scalable use offirewall resources, systems administration, and other purposes.

A graphic user interface (GUI) hosted on either the end point device(EPD) 25-100 or on the central control server (SRV_CNTRL) 25-200 canprovide information about the operations of the firewalls and also offerpoint and click control surfaces for users to utilize.

FIG. 26 illustrates, in accordance with certain embodiments of thedisclosed subject matter, two paths—one through the open Internet aswell as another path which is a combination of network optimized trafficvia global virtual network (GVN) segments over the top (OTT) of the baseInternet combined with open Internet segments.

One path is through the open Internet from hop P0-1 through P0-14 viaInternet local 26-CPT140 to Internet trans-regional 26-CPT340 toInternet local 26-CPT240.

The other path is also from hop P0-1 through P0-14 but differs from theprevious path as it goes from tunnel OTT last mile to GVN's SRV_AP26-CPT100 to long distance connectivity via GVN tunnel 26-CPT300 to EIPto target via Internet in remote region 26-CPT200.

Metrics about each block of network segments such as a measure of timeΔt=26−TZ ms for long distance connectivity via GVN tunnel 26-CPT300offer a quantifiable value which can be compared. Algorithmic analysiscan compare paths such as starting at 26-D00. One analysis of MeasureInternet QoS 26-D10 can look at the end-to-end open Internet path andthe other can look at Measure GVN QoS 26-D20. A compare and contrastevaluation is run at Connectivity Internet vs GVN 26-D30.

If the open Internet is better (26-DP40), then that path is used. If theGVN optimized path is better (DP-DP50), then that is used. This is onlyone embodiment for illustration purpose and is not limiting.

FIG. 27 illustrates a GVN using hub and spoke topology with a backboneand octagon routing in accordance with certain embodiments of thedisclosed subject matter. FIG. 27 shows the network topology of a GVN intwo different regions 27-RGN-A and 27-RGN-B and how the regions areconnected via paths 27-P0A and 27-P0B through global connectivity27-RGN-ALL. In addition, FIG. 27 shows the hub & spoke connections ineach of the two regions.

SRV_BBX 27-280 and SRV_BBX 27-282 are backbone exchange servers andprovide the global connectivity. SRV_BBX may be one or moreload-balanced servers in a region serving as global links. Access pointservers (SRV_AP) 27-302, 27-304 and 27-306 in 27-17-RGN-A connect toSRV_BBX 27-280. The central, control server (SRV_CNTRL) 27-200 servesall of the devices within that region and it may be one or more multiplemaster SRV_CNTRL servers. End point devices (EPD) 27-100 through 27-110will connect with one or more multiple SRV_AP servers through one ormore multiple concurrent tunnels.

This figure also shows multiple egress ingress points (EIP) 27-EIP420,27-EIP400, 27-EIP430, and 27-EIP410 in each region as added spokes tothe hub and spoke model with paths to and from the open internet. Thistopology can offer EPD connections to an EIP in remote regions routedthrough the GVN. In the alternative this topology also supports EPDconnections to an EIP in the same region, to and an EPD in the sameregion, or to an EPD in a remote region. These connections are securelyoptimized through the GVN.

FIG. 28 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a distributed end point administrative cluster(DEPAC) 28-800 which can be virtually constructed within a globalvirtual network (GVN) 28-000 or other similar topology.

Traffic between devices is carried within encrypted tunnels and thesetunnels join devices together into a broader network over the top (OTT)of the base Internet.

There are two types of end points described herein, an end point device(EPD) such as 28-120 behind which is a local area network (LAN) or aportable end point device (PEPD) such as 28-150 behind which is apersonal area network (PAN).

Other devices described herein are access point servers (SRV_AP) such as28-308 and a central control server (SRV_CNTRL) 28-200.

This topology offers security both for traffic through the tunnels aswell as by concealing the IP address of the device as its trafficegresses to the Internet via a remote egress ingress point (EIP).

Best and most efficient routing for traffic within a GVN 28-100 can berouted by an advanced smart routing (ASR) mechanism.

FIG. 29 illustrates the logical construction of a series of tests to berun on the Internet testing various ports and IP addresses in accordancewith certain embodiments of the disclosed subject matter. It allows fora specification of a range of ports to run on a specific IP Address viadata array 29-BT030.

A counter keeps track of tests 29-030. The results of each test aresaved in an array 29-090 which is then returned and logged at step29-800.

This algorithm can be used to test inventory of available IP and Portsassigned for production, to test and analyze IP and Port performance tothe same access point server (SRV_AP) to compare them. It is useful tolook at the results of current tests versus the performance logs ofproduction connectivity both to establish a baseline and to assesswhether tests results are within an expected performance range. And alsoto monitor network connectivity during tests to make sure tests do notaffect performance of other connectivity.

FIG. 30 illustrates a mechanism for logging of connectivity trafficactivity between various devices operating in a global virtual network(GVN) or other similar topologies in accordance with certain embodimentsof the disclosed subject matter. Such devices can include an end pointdevice (EPD) 30-100, and access point servers (SRV_AP) 30-300 and30-320.

A meter point of logging (MPoL) on network interfaces and virtualinterfaces and tunnel interfaces logs both inbound and outbound trafficfor each device.

So for example the tunnel TUN0 30-T00 between EPD 30-100 and SRV_AP30-300 has four such points of logging: on EPD 30-100 MPoL (inbound)30-108 and MPoL (outbound) 30-106 and on SRV_AP 30-300 MPoL (inbound)30-308 and MPoL (outbound) 30-306.

There exists a direct relation between the outbound MPoL on one deviceand the inbound MPoL on the device to which it is connected.

So for example, the outbound MPoL 30-306 on SRV_AP 30-300 measurestraffic sent to the EPD 30-100 and the direct correlation via path30-P108 to the inbound MPoL 30-108. The aggregate totals of traffic sentcan be compared to the amount of traffic received on the other end. Theamounts should be equal to each other. If the amount received is lessthan the amount transmitted, then this indicates loss. From a fairnessperspective on a consumption billing mechanism, if traffic is billed onthe EPD 30-100, it should be based on the traffic received on theinbound 30-108. Conversely traffic that reaches the SRV_AP 30-300 fromthe EPD 30-100 should be billed based on the amount received by theinbound MPoL 30-308 on the SRV_AP 30-300.

If a situation exists where the traffic received on an inbound MPoL isgreater than the traffic sent its corresponding outbound MPoL, this canindicate either an error or a malfunction or a data injection by amalicious player in the middle.

The difference between a bandwidth (BW) billing model and a consumption(CONS) billing model are that in a Bandwidth Model 30-1008, the trafficmay be shaped to an amount which is less than the carrying BW capacityof the line 30-1002. Conversely in a consumption based model there is noshaping of the BW and the max bandwidth 30-1086 may actually exceed therated BW carrying capacity of the line 30-1002.

The advantages of a BW model 30-1008 are that unlimited data traffic upto the amount in Mbps of the paid BW tunnel. There is a relatively highcost barrier for this and the actual utilization is usually only duringcertain hours with wasted capacity at other times.

The advantages of a CONS model 30-1088 are that there is no throttlingof tunnel so it can reach or even exceed the rated BW carrying capacityof the line. This model is advantageous because data will transfer asfast as possible and it is billed on a pay as you go basis. And paid bythe gigabyte GB transferred it can offer a low barrier to entry forconsumers.

FIG. 31 illustrates the traditional thick stack 31-20 layered accessbetween the application layer 31-800 and a network interface card (NIC)31-000 as compared to a thin stack approach 31-10 which directlyaccesses the NIC 31-000 in accordance with certain embodiments of thedisclosed subject matter.

The advantages of a thin stack over thick stack are that it is faster,consumes less resources, and therefore can process relatively morenetwork connectivity interactions.

FIG. 32 illustrates a simple example databases schema for relating andstoring connectivity information from both tests and productionenvironment usage.

Those experienced in the art will see its advantages. The tables, thefields, labels and other information are provided for reference only andmay differ in the various production deployments.

The Server Availability 32-280 module examines current allocation of IPaddress and port combinations while taking account actual use, load, andother factors of the live production environment. It further analyzesthe potential impact of assigned but standby allocations to predict theimpact of those resource demands going live.

When a device makes a request to the server availability module, what itis really asking for is a list of available servers, and specifically anIP and port which it could utilize to in the present or in the future tobuild a tunnel to. Each tunnel has specific information which needs tobe known to each pair in the tunnel building process as defined bytables under Tunnel information 32-220.

The list of server availability is tied to Connectivity Info used tomake tunnels 32-210 by both device ID 32-P288 and device type ID32-P220.

The Peer_Origin_ID refers to the ID of the originating device making thetunnel.

The Peer_Target_ID refers to the ID of the listening device to which thetunnel will be made. In most cases, Device_ID field in the array32-BT020 is equivalent to the Peer_Origin_ID field in the 32-BT020.

The List of Server Availability is therefore a list which can beutilized by all devices but for which a contextual list for one certaindevice is easily retrieved with contextual records relevant to it. Thefield Flag_State in array 32-BT020 is significant because it canindicate the state of this information, if it is unused, in production,retired, blocked or otherwise marked.

The server availability mechanism 32-280 considers many factorsbalancing demand for resources by clients such as EPDs wanting tobuilding tunnels against available resources of SRV_AP's which theywould connect with.

This governing mechanism ensures that automatic jumps of tunnels frommany EPDs to one specific device do not occur. For example, if all EPDsshare the same list of server availability, without an influence on howan EPD picks which servers to connect with, there are scenarios wheretoo many EPDs connect with some SRV_APs and too few to others. And whenthe EPDs connected to the oversaturated SRV_AP realize that they arereceiving less than optimal connectivity, if they share the same list,by jumping to the next server on the list, they will be causing a wobblyshifting of the problem down the line.

Server availability addressing this sort of scenario by ranking bestSRV_APs in order contextually for that specific EPD, and when generatingthe list, taking into account a holistic view and predictively spreadingload in anticipation of demand pressures on the production environment.

FIG. 33 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the usage of custom commands that act as adefensive cushion between a trigger on an application layer such as abutton clicked on a graphic user interface and the deep logic andcommands to be run as a result of the trigger.

The deeper a trigger's code execution can penetrate, the more risk ofcompromise to the system. This presents a conundrum because on one hand,an unprivileged client should not have deep access. Yet, certain scriptsthat a user will want to trigger will need to delve deep or they will berendered moot and not take effect when executed.

This figure has sufficient labelling so that a reader with reasonableskill in this area will be able to understand the information flow.

The step executing custom command 33-200 presumes that the triggeringuser has limited rights only to the Custom Commands 33-L20 executionlevel and not below. These limited rights preclude the ability to runsensitive commands, to access deep folders or files, or otherwise harmor penetrate deeper levels of the system. The path 33-P150 to “customcommand is privileged to call deeper scripts and commands 33-D150”defines a sequence and series of steps that will allow the specificcustom command to run the intended specific functionality in a safe andsecure manner.

At “O/S installed packages+configs” 33-12, the embedded commands withinthe custom command may be able to evoke control over deep O/S levelfunctionality but in a controlled manner. The lowest possible levelcommands may also be evoked but in a controlled manner and only based onthe contents of an untampered custom command.

Therefore, the triggering user cannot dig deeper than 33-L20 and has noright to call sensitive commands, however by the action of calling acustom command to which they are allowed access, the contents of thecustom command file can be run at an elevated rights state withoutcompromising the security of the system, with only the calling andpotentially the result of the custom command being available to thetriggering client 33-800.

FIG. 34 is a simplified description of the modules on related devices ina geographic destination mechanism within a global virtual network (GVN)in accordance with certain embodiments of the disclosed subject matter.It describe interaction between content delivery agent (CDA) and thecontent pulling agent (CPA).

While the CDA and CPA and associated modules are designed to runindependently, there exists a flow of information between them whichtrigger operations of each.

For example, the ASR module on the EPD 34-D120 will be able to advisethe CDA 34-D110 that a URL is to be fetched from the remote region wherethe SRV_AP 34-300 is located. The CDA 34-D110 will communicate with theCPA 34-D310 via path 34-CP310 that it desires the geographic destinationmechanism to fetch this content and all associated content at that URLfrom the remote region.

The CPA 34-D310 instructs the remote fetcher BOT (RFBOT) 34-D312 to do alook-up at 34-D350 to find the exact target server and to have the RFBOT34-D312 fetch that content. CPA 34-D310 parses the content for embeddedlinks to more included content which it then asks the RFBOT 34-D312 tofetch.

The subsequently pulled content is inventoried by the CPA 34-D310 fortwo purposes. First is to send the manifest and the retrieved data tothe cache manager 34-D330, as well as a copy of the manifest back to theCDA 34-D110.

This collaboration is useful because the CDA 34-D110 is able tocoordinate with the cache manager 34-D130 to expect the receipt of thefetched data and can compare the data received against the manifestcreated by the CPA 34-D310. There are efficiency gains realized by thiscontrolled approach as well as security advantages because the receiveddata must match the manifest or red flags could trigger scrutiny ofeither possible malfunction or malicious man-in-the-middle type of dataalteration attack.

The SRV_CNTRL 34-200 is useful as a neutral channel for informationconveyance between devices, and also for holistic management of thechained caches on various devices.

FIG. 35 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a few ways how a portable end point device(PEPD) such as 35-150 or 35-152 might connect to a global virtualnetwork (GVN) 35-000 or similar topology. In this example, the PEPD35-150 has multiple connection options to three different devices. Firstto two different access point servers (SRV_AP) 35-304 via paths 35-T10Bto 35-T10A in a region close to it, as well as to SRV_AP 35-300 inanother region via paths 35-T12A to 35-T12B. A third option for PEDP35-150 is to EPD 35-100 via 35-T12A to 35-T12C.

The PEPD may connect to as many SRV_AP servers as its resources and itsrights via a server availability mechanism permit. However, for a PEPD35-150 to connect to an EPD 35-100, they must have a relationshipbetween them such as what would exist if both belonged to the samedistributed end point area cluster (DEPAC) and rights were granted forthe PEPD to connect to that EPD.

FIG. 36 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationship between a portable end pointdevice (PEPD) 36-150 and an access point server (SRV_AP) 36-300. Itfurther describes some of the modules on each of the aforementioneddevices. The PEPD 36-150 will typically have a comparatively smalleramount of physical resources such as processing power 36-106, RAM36-102, storage 36-H100, and other system attributes. An SRV_AP 36-300can be a cloud based dynamic virtualized instance offering huge amountsof RAM 36-302, processing power 36-306, storage 36-H300, and otherresources.

The PEPD 36-150 will typically have a minimal operating system 36-110,simple security suite 36-114, minimalized system software 36-120 andgenerally a small footprint. This barebones approach ensures that thereexists a balance between functionality required and other relatedfactors such as cost, battery consumption, physical size, and more.

One solution is for a virtual software container 36-160 to be availableon the PEPD 36-150 which is able to either download and run softwarelocally, or to act as a hook point for a symbolic link between localsystem and software run on a remote location such as on the SRV_AP36-300.

This arrangement is possible and secured by a tunnel TUN0 between thetwo devices through which not only data traffic can flow through butalso software commands, queries, results, and other functionality whichcan be remotely run.

There exist several advantages to this approach as mentioned but othersmay also exist.

FIG. 37 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some of the different types of extensiblesoftware that may be run on a portable end point device (PEPD) 37-150where the software is stored on a remote device such as an access pointserver (SRV_AP) 37-300 to be sent from 37-158 to the PEPD 37-150.

The first type is core software stored and running on the PEPD 37-150such as software downloaded and locally executed 37-1520. Another typeis remotely run distributed software 37-1300 which tethers the PEPD37-150 to an SRV_AP 37-300 where the software is run.

There exist many advantages to this mechanism, including efficient useof PEDP resources, as well as ensuring that the most recent version ofsoftware is up and running.

Another element is the protection of the intellectually property of theproducer of the software due to the fact that some physically lives inone location and run with results used by a software hook point inanother location. In such a topology, both devices would have to beaccessed to have visibility to the complete framework, codebase, andrun-time attributes.

FIG. 38 illustrates, in accordance with certain embodiments of thedisclosed subject matter, multiple tunnels between devices within aglobal virtual network (GVN) across multiple regions. The EPD 38-100 isin one location 38-MO. SRV_APs in region 38-M2 include SRV_AP 38-300,SRV_AP 38-302, and SRV_AP 38-304. SRV_APs in region 38-M3 SRV_AP 38-310,SRV_AP 38-312, and SRV_AP 38-314. Advanced smart routing (ASR) is usedto manage routing over the multiple tunnels and paths between the EPD38-100 and the various SRV_AP devices. ASR can mitigate the risk oflooping, wrong geographic destination routing, ASR remote redirectbacktrack, broken links between SRV_APs, regions, and other problems.

FIG. 39 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the framework for a common code base to beutilized by various types of devices, with each having their ownattributes/type and identity.

A hardware UUID 39-110 utilized by a device identity module 39-100,related to device related records stored in a database 39-B100, andcalling an identity class 39-120 sets up many different contextualrelationships for that specific device.

Within the scope of a common code framework, by a device knowing aboutits own identity from a few sources via 39-100, it can glean many thingssuch as its role 39-310, its type 39-300, which elements of the basecode pertain to it 39-200, which applications it should load and execute39-800.

Knock on logical next steps are that by knowing device type 39-300,device type specific modules 39-320 can be loaded, and these along withdevice role 39-310, can trigger O/S specific modules to be loaded 39-500to sustain operations for that type of device.

Device type 39-300 and role 39-310 also have impact on peering peer pairrelationships 39-520, as well as on operations and integration 39-600.

Once the environment specific to that device is operational,applications 39-800 can be run contextually for that specific device.

It should be evident to readers with sufficient skill in this area.

FIG. 40 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationships, interaction, and relevanceof data to various devices within a global virtual network (GVN).

The Port and IP Address Manager 40-200 will use various data abouttunnels 40-270, about servers 40-220, and other factors to assignresources for server availability 40-260 to then utilize and dole out tovarious devices.

There are logical relationships between data such as a list of Devices40-110, and Servers 40-220, and how modules interact with each other touse this information.

Internal Subnet Manager [EPD_subnets]+[SRV_AP subnets]+[Infrastructuresubnets] 40-300 uses this information to both calculate subnet rangeswhich could be used while avoiding conflicts and also “reserving” rangesto ensure no future conflicts; both in automatic settings and also inmessaging to administrators regarding use.

The global virtual network (GVN) relies on various devices which worktogether to weave together a network type over the top (OTT) of theInternet. A registry 40-B100 keeps track of devices, of theirrelationships, their specifications, their type, and other factors. Coreelements of the system include modules and managers that work togetherto construct and efficiently manage the GVN construct.

The advanced smart routing (ASR) Manager 40-500 looks at both the baseinternet connectivity as well as the network within the GVN layer OTTthe internet. In order for automated systems to operate efficiently andeffectively, Port and IP Address Manager 40-200 and Internal SubnetManager 40-300 interact with various other modules.

Server Availability 40-260 looks at the tunnels 40-270, their IP andport use 40-276, reviews connectivity tests 40-158, both current andhistorical, calculates port availability based on usage per IP Address,the IP addresses assigned to servers 40-122, devices 40-210, and otherfactors to manage how server resources are utilized and assigned.

The server availability module's main benefit is to catalog theresources usage, IP addresses and ports of access point servers (SRV_AP)and to look at which devices 40-210 such as end point devices (EPD) thatwould like to connect to SRV_AP's to build tunnels (TUNs) 40-270 withthem. The server availability module calculates and compiles acustom-made list of IP Addresses and Ports which are contextuallydesigned to provide best options for EPD's to utilize. The tunnelregistry 40-150 allows Server Availability to review Db: ConnectivityTests 40-158 and based on current and historical conditions to weigh andrank best connectivity options for both tunnels 40-270 to be built andfor routing via ASR 40-500.

Distributed end point administrative clusters (DEPAC) 40-250 are anextension of the construct of a GVN. DEPACs allow for the linking of thelocal area network (LAN) and personal area network (PAN) subnets behindEPD and portable end point devices (PEPD) 40-210 into a broaderconnected network by joining the subnets together 40-300. The Internalsubnet manager needs to positively know about EPD subnets, SRV_APsubnets for tunnels, and other related infrastructure subnets 40-300, sothat when it assigns new ones and stiches an edge of one subnet withanother one into as broader fabric, by knowing about ones currently inuse, it ensures that there are no conflicts of overlapping assignmentsof subnets.

The Db of IP address assignments 40-120 provides the information to beused by the internal subnet manager 40-300. The DEPAC clusters 40-250have member devices 40-210 and each device has an identity 40-212 uniqueto it.

There are also relationships between Users 40-280, and devices 40-210based on device identity 40-212 governed by an identity class or similarlogic 40-282. Users can therefore administer DEPAC clusters.

The described topology allows for automatic and manually assistedconstruct of tunnels 40-270, with efficient routing thanks to ASRManager 40-500, and other factors.

If a device is malfunctioning, needs to be updated, is oversubscribed,or is in another state which is not optimal, a device flag 40-112 forthat device can be set to something other than “available” so that theServer Availability module 40-260 can know that that device is notavailable to be assigned to new server availability lists which would bepublished to other devices to utilize.

Other benefits are that analysis of historical use can be compared withcurrent conditions and AI algorithms used to make decisions pertainingto routing, to resource allocation, and other factors.

Centralized real-time monitoring of connectivity, resources use, andother factors is made possible by accessing the data in the databaseregistry 40-B100 and displaying it in a GUI.

Administration is made easier by automated systems which utilizeinformation provided by GVN modules and managers to build and manageelements of the construct.

Deep analysis is possible for traffic flow, paths as set by ASR, serveravailability 40-260 and other modules not displayed here. This not onlyfacilitates visibility on past and current use, but can serve as a basisfor predictive cognitive analytics of how a future connectivity willoperate.

FIG. 41 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the topology of a global virtual network (GVN)over the top (OTT) of the Internet and various devices operating withinit. Some examples of devices include end point devices (EPD) such as EPD41-110, portable end point devices (PEPD) such as 41-152, access pointservers (SRV_AP) such as 41-308, and central control server (SRV_CNTRL)such as 41-200, and more.

There are also egress ingress points (EIP) such as 41-318 between a GVNdevice such as SRV_AP 41-308 and the Internet such as 41-018.

In FIG. 41, there also exists another layer representing two independentdistributed end point administrative clusters DEPAC0 and DEPAC2.

The members of DEPAC0 are PEPD 41-150, EPD 41-102, and EPD 41-106.

The members of DEPAC2 are EPD 41-100, PED 41-152, EPD 41-110, and EPD41-108.

DEPAC members connect to each other through existing GVN pathways andonly connect subnets together and link internal tunnels joining localarea networks (LANs) and personal area networks (PANs) into a wider widearea network (WAN).

FIG. 42 illustrates, in accordance with certain embodiments of thedisclosed subject matter, code both above the web root 42-Bound2 andbelow the web root 42-Bound0.

The bare minimum of code should be stored in files within folders whichare directly accessible from the open internet below the web root42-Bound0.

Sensitive files including configuration file, classes, functions,credentials, sensitive info, and other files are stored above the webroot 42-Bound2.

While it may be argued that the server side script package (parser)42-D110 should process the sensitive code within files when they areretrieved, there are instances when a malfunction or misconfiguration orhacking could allow the file to be downloaded which gives directvisibility to the embedded code which should have been executed.

The only server side code included in the files stored below should berelative links to files above the web root 42-Bound4.

The terms above and below refer to file paths such as:

/volume/folder/instance/code/secure/*** secure folders and paths here/volume/folder/instance/code/public/http/ALL_here_is_on_open_internet_HTTP/volume/folder/instance/code/public/https/ALL_here_is_on_open_internet_HTTPSThe web root(s) in the above examples are:

/volume/folder/instance/code/public/http//volume/folder/instance/code/public/https/

Anything above those is only accessible from within the server, notreachable via internet. And all files and folders within the http andhttps folders are reachable.

FIG. 43 illustrates, in accordance with certain embodiments of thedisclosed subject matter, algorithms incorporating information fromexternal sources with AI knowledge learned internally.

The step Start checking veracity of Info 43-000 does so by source andtype of info.

Defined patterns 43-102 can be validated by 43-P108 to become rules.Warnings 43-122 based on information from others may either bedisregarded or they too could become rules 43-112.

FIG. 44 illustrates, in accordance with certain embodiments of thedisclosed subject matter, a simplified representation of an approach todesigning a smarter algorithm by taking into account factors that onehas and balancing against one's personal needs. In this “juices”example, the “blend something together 44-130” step can be described asa process which is important to focus on to achieve the desired result.The “analysis of needs met 44-140” determines if best result has beenachieved if the process should run again with slightly different inputsand methods to get closers to desired result.

In some embodiments, based on haves and needs for best income, duringthe process elements may be utilized which are not incorporated in theproduct of the final process but still have an impact on the result. Toextend the juice example out, a citrus peel can cheer a person up (e.g.,the maker of the juice) when peeling the fruit but it is ultimatelydiscarded and not used. Another example is that apple and orange areboth good for one's health but citrus may not be ideal for someone withan acidity condition.

Key point is for an algorithm to be flexible and to take into accountvarious conditions, processes, inputs, and outputs taking a holisticapproach to evaluation.

FIG. 45 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device EPD 45-100, central control server SRV_CNTRL 45-200, and anaccess point server SRV_AP 45-300. This figure also illustrates database5100 on EPD 45-100, database 5200 on SRV_CNTRL 45-200, repositorydatabase 5202 on SRV_CNTRL 45-200, and database 5300 on SRV_AP 45-300.The figure is hierarchical, with lowest level hardware devices at thebottom, and subsequent systems, components, modules and managers builton top of lower layers. Files and data are stored on the HierarchicalFile System (HFS) attached storage devices 45-H100 on EPD 45-100,45-H200 on SRV_CNTRL 45-200, and 45-H300 on SRV_AP 45-300. Thecomponents illustrated in these systems diagrams all operateindependently but may also rely on information about other devices thatthey interact with.

RAM stands for random access memory, CPU for central processing unit(which can also include sub-processors), NIC for network interface card,Db for database software, DNS for domain name system, HOST for hostingsoftware, API for application programming interface, ASR for advancedsmart routing, GeoD for geodestination, GVN for global virtual network,CDA for content delivery agent, CPA for content pulling agent, and RFBOT for remote fetcher bot. There may be additional modules, mangers,systems, or software components.

FIG. 46 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device EPD 46-100, central control server SRV_CNTRL 46-200, and anaccess point server SRV_AP 46-300. This figure further identifiessubsystems for each device such as EPD sub-sys 46-1000 for EPD 46-100,SRV_CNTRL Sub-sys 46-2000 for CNTRL 46-200, and SRV_AP sub-sys 46-3000for SRV_AP 46-300. Subsystems have been identified by function and areindicated with prefixes including FW for firewall related subsystems,TUN for tunnel related subsystems, VIF for virtual interface relatedsubsystems, SRV_Avail for the server availability list and relatedsubsystems, BUFF Mgr for buffer management and related subsystems, LOGfor the logging module and related subsystems, and CONNECTIVITY forgeneral connectivity operations.

FIG. 47 illustrates, in accordance with certain embodiments of thedisclosed subject matter, some system modules and components for an endpoint device EPD 47-100, central control server SRV_CNTRL 47-200, and anaccess point server SRV_AP 47-300. Subsystems have been identified byfunction and are indicated with prefixes including Connectivity forgeneral connectivity operations, ASR for advanced smart routing, API forapplication programming interface, LOG for the logging module andrelated subsystems, GeoD for the geodestination module and relatedsubsystems, SRV_Avail for server availability list and relatedsubsystems, Buffer for buffer management and related subsystems.

FIG. 48 illustrates a block diagram of an exemplary computing device4800 according to certain embodiments of the disclosed subject matter.In some embodiments, the computing device 4800 can be any suitabledevice disclosed in the current invention. The computing device 4800 caninclude at least one processor 4802 and at least one memory 4804. Theprocessor 4802 can be hardware that is configured to execute computerreadable instructions such as software. The processor 4802 can be ageneral processor or be an application specific hardware (e.g., anapplication specific integrated circuit (ASIC), programmable logic array(PLA), field programmable gate array (FPGA), or any other integratedcircuit). The processor 4802 can execute computer instructions orcomputer code to perform desired tasks. The memory 4804 can be atransitory or non-transitory computer readable medium, such as flashmemory, a magnetic disk drive, an optical drive, a programmableread-only memory (PROM), a read-only memory (ROM), a random accessmemory (RAM), or any other memory or combination of memories.

In some embodiments, the memory 4804 includes a module 4806. Theprocessor 4802 can be configured to run the module 4806 stored in thememory 4804 that is configured to cause the processor 4802 to performvarious steps that are discussed throughout the disclosed subjectmatter.

FIG. 49 illustrates a process of the downloading of a file in a LAN aswell as the downloading a file from the Internet in accordance withcertain embodiments of the disclosed subject matter. It compares andcontrasts the file served by EPD at LAN edge 49-880 to file served byremote server 49-840.

Downloading a file within a LAN 49-880 offers total control overfirewalls, filtering, as well as relatively high bandwidth (BW),ultra-low latency, an a small number of hops, and other advantages.

Downloading from a remote server on the open internet has very little tono control over the path in the middle and there can also be filteringfrom firewalls or constrictions due to middle devices.

By optimizing the traffic in the middle, many issues get resolved.However, the download BW is still constricted by the last mileconnection or the smallest peering point or network segment.

Therefore the download of file 49-810 from a remote server from a remoteinternet 49-050 will in most cases be slower than downloading a file49-800 from the LAN 49-020.

FIG. 50 illustrates the operation of a file transfer manager (FTM) on anend point device (EPD) 50-100 and of an FTM 50-360 on an access pointserver (SRV_AP) 50-300 in accordance with certain embodiments of thedisclosed subject matter.

The client 50-000 initiates the upload transfer of a file 50-800 to theserver 50-350 via the path 50-P000 to LAN 50-020 to EPD 50-100 whichroutes the traffic through a global virtual network (GVN) 50-020 over anoptimized, long distance 50-980 to SRV_AP 50-300 to 50-P050 to theInternet in the remote region 50-050 and on to the server 50-350 viapath 50-P350. The server 50-350 accepts the connection from client50-000 and begins the process of receiving the file in multi-partattachments sent within a stream of packetized payloads.

For files larger than a certain size set by a threshold parametervariable, the original upload stream of file 50-800 from the client50-000 is detected at step 1 50-10 by the FTM 50-160 and this filestream is then captured and pulled into the file cache 50-180 on the EPD50-100. As this network path is an extremely short distance withsuper-low latency 50-920, the remaining data in the file uploadcompletes uploading very quickly thus reducing the upload time from theclient's perspective. This has the advantage of freeing the client up.The FTM 50-160 maintains the stream of the upload to server 50-350 andsends this data from file cache 50-180 while receiving and after havingalready received the complete file, it continues the upload on behalf ofthe client until the upload is complete.

At step 1 50-10, the original stream is detected, and only after theserver accepts the connection and opens up a valid socket is the streamdeemed as valid.

At step 2 50-12, the upload stream is redirected into the local filecache 50-180 to accumulate there at the high rate of speed of the LAN50-020. It will also continue to be sending the upload steam to server50-350 via the optimized GVN topology, including transit at step 3 50-28to the file cache 50-380 on the SRV_AP 50-300 in the remote region inclose proximity to the target server 50-350.

The FTM 50-360 on SRV_AP 50-300 maintains the connection and sends thefile 50-810 to the server 50-350 as fast as it can via path 50-P350.Step 5 50-32 notes that this is where the connection is kept alive andhealthy, and where the file 50-810 will egress the GVN at a shortdistance and low latency 50-950 between the SRV_AP 50-300 and the server50-350.

FIG. 51 illustrates, in accordance with certain embodiments of thedisclosed subject matter, the relationship between the physical storageof a file on a secure file storage volume 51-H750, the saving ofinformation about the file into a relational database (DB) such as51-B700, and data relationships between files, file information, andsteps in a file transfer process. When a file is sent from a client51-000 to a server 51-350 via an upload stream capture, and chainedcaching of the file by saving it in a file cache 51-180 close to thesource file, pushing the file to the next file cache 51-380, and thensaved to the server 51-350 governed by file transfer manager (FTM)51-360. A multi-dimensional array 51-BT030 describing info about thefile (File_Info), the path through the GVN that the file should take(File_Path), as well as Meta data (File_Meta), and destinationinformation (Dest_Info). The destination info includes target devicetype, credentials if required, and other information.

The sub-array for file path multi-dimensional array 51-BT050 includesinformation about the origin, the target, as well as the intermediaryhops.

There is a sub-array describing the characteristics of each hop51_BT-070 includes information about the device, its type, a code orhostname for it, and other information. This sub-array is also linked totable: devices 51-730.

The table: Files 51-720 contains information about the file, including auniversal unique identifier for the file 51-722. The file name on thephysical storage can be the UUID 51-722 with a symbolic link via table:files 51-720 of the UUID to the file info record including the name ofthe file.

It is to be understood that the disclosed subject matter is not limitedin its application to the details of construction and to thearrangements of the components set forth in the following description orillustrated in the drawings. The disclosed subject matter is capable ofother embodiments and of being practiced and carried out in variousways. In addition, it is to be understood that the phraseology andterminology employed herein are for the purpose of description andshould not be regarded as limiting.

As such, those skilled in the art will appreciate that the conception,upon which this disclosure is based, may readily be utilized as a basisfor the designing of other structures, systems, methods and media forcarrying out the several purposes of the disclosed subject matter. It isimportant, therefore, that the claims be regarded as including suchequivalent constructions insofar as they do not depart from the spiritand scope of the disclosed subject matter.

Although the disclosed subject matter has been described and illustratedin the foregoing exemplary embodiments, it is understood that thepresent disclosure has been made only by way of example, and thatnumerous changes in the details of implementation of the disclosedsubject matter may be made without departing from the spirit and scopeof the disclosed subject matter, which is limited only by the claimswhich follow.

1. (canceled).
 2. A method comprising: receiving, by one or more computer processors, a request for a list of available servers from a network device; retrieving, by the one or more computer processors, the list of available servers; retrieving, by the one or more computer processors, one or more records associated with the network device; dynamically ordering, by the one or more computer processors, the list of available servers based on the one or more records associated with the network device; and transmitting, by the one or more computer processors, the ordered list of available servers to the network device.
 3. The method of claim 2, wherein the network device is an endpoint device.
 4. The method of claim 3, wherein at least one server among the list of available servers is an access point server.
 5. The method of claim 2, further comprising anticipating a level of demand for at least one server among the list of available servers, and wherein dynamically ordering the list of available servers is further based on the anticipated level of demand.
 6. The method of claim 2, wherein dynamically ordering the list of available servers is further based on one or more second ordered lists of available servers transmitted to one or more second network devices.
 7. The method of claim 2, wherein dynamically ordering the list of available servers comprises generating ranking information for each server in the list of available servers.
 8. The method of claim 2, wherein the one or more records are retrieved based on a unique device identity associated with the network device.
 9. A system comprising: a memory storing instructions; and one or more processors coupled to the memory, the one or more processors being configured to execute the instructions, the instructions when executed causing the one or more processors to perform operations comprising: receiving a request for a list of available servers from a network device; retrieving the list of available servers; retrieving one or more records associated with the network device; dynamically ordering the list of available servers based on the one or more records associated with the network device; and transmitting the ordered list of available servers to the network device.
 10. The system of claim 9, wherein the network device is an endpoint device.
 11. The system of claim 10, wherein at least one server among the list of available servers is an access point server.
 12. The system of claim 9, wherein the operations further comprise anticipating a level of demand for at least one server among the list of available servers, and wherein dynamically ordering the list of available servers is further based on the anticipated level of demand.
 13. The system of claim 9, wherein dynamically ordering the list of available servers is further based on one or more second ordered lists of available servers transmitted to one or more second network devices.
 14. The system of claim 9, wherein dynamically ordering the list of available servers comprises generating ranking information for each server in the list of available servers.
 15. The system of claim 9, wherein the one or more records are retrieved based on a unique device identity associated with the network device.
 16. A network system for managing a global virtual network, comprising: an access point server configured to connect to one or more endpoint devices via one or more first tunnels; and a control server connected to the access point server via a second tunnel, the control server storing one or more records associated with each of the one or more endpoint devices, wherein the control server is configured to: receive a request for a list of available servers from a first endpoint device among the one or more endpoint devices, the list of available servers including the access point server; retrieve the list of available servers; retrieve the one or more records associated with the first endpoint device; dynamically order the list of available servers for the first endpoint device based on the one or more records associated with the network device; and transmit the ordered list of available servers to the first endpoint device.
 17. The network system of claim 16, wherein the control server is further configured to predict a level of demand for the access point server, and wherein dynamically ordering the list of available servers is further based on the anticipated level of demand.
 18. The network system of claim 16, wherein dynamically ordering the list of available servers is further based on one or more second ordered lists of available servers transmitted to one or more second endpoint devices among the plurality of endpoint devices.
 19. The network system of claim 16, wherein dynamically ordering the list of available servers comprises generating ranking information for each server in the list of available servers.
 20. The network system of claim 16, the one or more records are retrieved based on a unique device identity associated with the first endpoint device.
 21. The network system of claim 16, wherein the control server receives tunnel information associated with the one or more first tunnels via the global virtual network, and wherein dynamically ordering the list of available servers is further based on the tunnel information. 